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ABSTRACT 
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the  multigrid  fixed  point  theorem  for  multigrid  cycles  combining  MGP  with  backrotations,  are  presented.  The 
MGP  and  the  backrotations  are  central  eigenvector  separation  techniques  for  multigrid  eigenvalue  algorithms. 
They  allow  computation  on  coarse  levels  of  eigenvalues  of  a  given  eigenvalue  problem,  and  are  efficient  tools 
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1  Introduction 


In  [1],  [2]  we  present  multigrid  (MG)  eigenvalue  algorithms  for  linear  and  nonlinear  eigenvalue 
problems,  whose  robustness  and  efficiency  rely  much  on  the  multigrid  projection  (MGP)  and  on 
the  backrotations,  introduced  in  [3],  [4],  [5].  The  applications  were  for  Schrodinger  and  electromag¬ 
netism  eigenvalue  problems.  MGP  allows  computation  on  coarse  levels  of  the  eigenvalues  of  a  fine 
level  eigenvalue  problem.  This  is  stated  by  the  MGP  theorem  whose  proof  is  given  in  a  general 
algebraic  setting,  in  Section  4.  The  MGP  coupled  with  backrotations,  relaxations,  and  inter-level 
transfers  form  the  MG  cycles,  which  are  used  in  the  computation  of  eigenvectors.  A  central  re¬ 
quirement  for  MG  eigenvalue  algorithms  is  that  the  MG  cycles  should  have  as  fixed  points  the  fine 
level  solutions.  In  Section  6  we  prove  that  this  requirement  is  met  by  the  MG  cycles  presented  in 
Section  5.  The  MGP  coupled  with  backrotations  also  improve  the  efficiency  and  robustness  of  MG 
algorithms.  Computational  examples  which  motivate  the  need  of  backrotations  and  illustrate  the 
efficiency  of  the  presented  techniques  are  shown  in  Section  7. 

For  MG  techniques  and  more  on  MG  eigenvalue  algorithms,  we  refer  to  [6],  [7],  [8],  [9].  For 
algorithms  and  theory  on  algebraic  eigenvalue  problems  we  refer  to  [10],  [11],  [12],  [13]. 

2  Generalized  Rayleigh  Ritz  Projections 

Assume  that  A,  U,  T  are  given  matrices,  A  of  dimensions  nxn,  and  U  and  T  of  dimension  nxq. 
From  now  on,  if  not  otherwise  specified,  a  pair  {E,A)  refers  to  q  x  q  matrices  E  and  A  where  E  is 
invertible  and  A  is  diagonal.  It  is  said  that  a  pair  {E,A)  is  a  solution  for  (A,  U,T)  if: 

AUE  =  UEA  +  TE  (1) 

The  separation  problem  requires  to  find  solutions  {E,A)  of  (1)  for  given  (A,  17,  T).  In  a  single 
level  approach  this  problem  is  treated  by  Rayleigh  Ritz  type  projections,  while  in  a  multigrid 
approach  the  problem  is  treated  by  multigrid  projections. 

If  T  =  0  and  {E,A)  is  a  solution  for  (A,  U,T)  then  UE  are  eigenvectors  of  A  associated  to  the 
eigenvalues  of  A.  There  may  be  no  solutions  for  (A,  U,T).  For  example,  if  T  =  0  or  T  =  17,  and 
q  =  1  there  is  no  solution  unless  U  is  an  eigenvector. 

The  pairs  (E,A)  and  {F,Q)  will  be  called  equivalent  if 

EAE-^  =  FQF-^  (2) 
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Lemma  1  If  the  columns  of  U  are  linearly  independent  then  any  two  solutions  for  {A,  U,T) 
are  equivalent. 

Proof  From  (1)  results 

AU-T  =  UEAE-^  =  UFSF-^  (3) 

and  since  the  columns  of  U  are  independent  results  (2). 

Lemma  2  If  the  pairs  (E,  A)  and  (F,  0)  are  equivalent  and  {F,  0)  is  a  solution  for  (A,  U,T) 
then  (F,A)  is  a  solution  for  (A,  U,T). 

Proof  By  (2)  the  relation  (3)  is  obtained  and  from  here  (1) 

If  the  columns  of  U  are  not  linearly  independent  then  nonequivalent  solutions  for  (A,  U,T)  may 
exist.  For  instance  let  9  =  3,  T  =  0  and  consider  a  matrix  A  which  has  the  eigenvectors  Ui,  U2 
with  respective  eigenvalues  1  and  2.  Let  U  =  {Ui,  U2,  U2)-  One  solution  [E,  A)  has  A  =  diag{l,  2, 2) 
with  E  the  identity,  and  a  second  solution  (jF, 0)  has  0  =  diag{l,2,0)  with  /  having  the  first  two 
columns  the  corresponding  columns  of  the  identity  matrix,  and  the  third  column  (0, 1,  —1)^.  The 
two  solutions  are  not  equivalent  since  the  sets  of  eigenvalues  in  the  two  pairs  are  different,  while  in 
(2)  they  are  obviously  the  same. 

Since  the  problem  of  finding  a  pair  {E,A)  which  satisfies  (1)  may  not  have  solutions,  it  is 
reduced  to 

Y'^iAUE  -  UEA  -TE)  =  0  (4) 

i.e.,  the  projection  of  the  residuals  of  (1)  on  the  space  spanned  by  the  columns  of  Y,  should  be 
minimal.  Solutions  {E,A)  to  (4)  can  be  obtained  from  the  smaller  q  x  q  generalized  eigenvalue 
problem: 

{Y^{AU  -T))E  =  {Y^U)  EA  (5) 

One  may  choose  Y  in  different  ways,  e.g.,  either  Y  =  U,  or,  in  an  MG  setting,  Y  may  be  the 
transfer  of  the  solution  from  another  level,  or  Y  may  consist  of  approximations  of  left  eigenvectors 
of  A.  Finding  a  pair  {E,A)  which  satisfies  (5)  is  referred  as  Generalized  Rayleigh- Ritz  Projection 
(GRRP). 

Remarks  The  T  term  makes  the  difference  between  the  usual  Rayleigh- Ritz  projection,  (where 
T  =  0),  [11],  [13],  and  the  projection  presented  here.  T  is  introduced  by  transfers  in  MG  algorithms, 
as  shown  in  Section  5.  The  T  changes  the  usual  linear  eigenvalue  problem  for  U,  AU  =  U A,  into 
a  nonlinear  problem  AU  =  UA  +  T.  Before  GRRP,  the  U  can  be  multiplied  FF  by  an  invertible 
matrix  F,  e.g.,  to  orthonormalize  the  columns  of  U.  The  previous  solutions  E  will  become  F~^E. 
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3  Backrotations 


Backrotations  [5],  [2]  are  central  separation  techniques  in  MG  algorithms  for  eigenvalue  problems. 
A  separation  matrix  E  obtained  from  a  projection  may  combine  arbitrarily  or  even  overlap  the 
eigenvectors  in  a  degenerate  eigenspace,  (as  was  often  observed  in  tests  [2]).  (  This  results  in  the 
observation  that  if  F  commutes  with  A  from  (1),  and  if  is  a  solution  of  (1)  then  EF  is  a  solution 
also.)  Difficulties  may  occur  for  close  eigenvalues  and  when  the  eigenspaces  are  not  well  enough 
approximated.  E  may  permute  or  rescale  the  columns  of  U.  The  role  of  backrotations  is  to  correct 
these  in  MG  algorithms.  If  U  is  the  solution  of  the  problem  then  E  should  be  the  identity.  When 
U  is  close  to  the  solution  then  an  E  obtained  by  the  projection  should  be  brought  close  to  the 
identity.  In  the  next  backrotation  algorithm,  it  is  desired  that  the  eigenvalues  be  ordered,  (e.g.,  by 
modulus),  except  in  close  clusters  where  ordering  of  eigenvalues  is  not  important  but  the  vectors 
of  UE  are  desired  to  be  close  to  the  vectors  of  U. 

Backrotation 
Input  {E,A) 

1 )  Sort  the  eigenvalues  of  A  and 

permute  the  columns  of  E  accordingly 

2)  Determine  the  clusters  of  eigenvalues  of  A 

3)  For  each  diagonal  block  in  E 

associated  with  a  nondegenerate  cluster  do: 

bring  to  the  diagonal  the  dominant  elements  of  the  block, 

permuting  the  columns  of  E 

and  the  diagonal  of  A  correspondingly. 

4)  Let  F  be  a  block  diagonal  matrix 

whose  diagonal  blocks  are  the  diagonal  blocks  of  E 
corresponding  to  the  determined  clusters. 

Replace  each  diagonal  block  which  does  not  correspond 
to  a  degenerate  cluster  by  the  corresponding  identity  matrix 

5)  Set  E  =  EF-K 

6)  Change  the  signs  of  columns  of  E 

to  get  positive  elements  on  diagonal. 

7)  Normalize  the  columns  of  E. 

Output  {E,A) 

Assume  that  F  =  17  in  the  GRRP.  Denote  by  Id  the  identity  matrix.  The  projection  and 
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backrotation  should  provide  the  solution  {Id,  A)  if  the  equation  AU  =  UA  +  T  is  satisfied,  (i.e.,  if 
{Id,  A)  is  one  of  the  solutions),  U  has  linearly  independent  columns,  and  the  eigenvalues  in  A  are 
sorted. 

This  is  assured  by  the  following  lemma: 

Lemma  S  If  U  has  independent  columns,  the  eigenvalues  on  the  diagonal  of  A  are  sorted  and 

AU  =  UA  +  T  (6) 

then  the  solution  of  the  projection  and  backrotation  is  {Id,  A). 

Proof  Assume  that  {E,  A')  is  a  solution  obtained  by  the  projection,  with  E  nonsingular.  Since 
U  has  independent  columns  and  {Id,  A)  is  a  solution  for  {A,  U,T),  it  follows  from  Lemma  1  that 

EA'E-^  =  A  (7) 

Thus  A  and  A'  have  the  same  eigenvalues.  Then  the  sorting  at  Step  1)  in  the  backrotation  algorithm 
wiU  make  A'  =  A.  If  all  eigenvalues  in  A  are  different  then  the  initial  E  is  just  a  permutation  and 
the  sorting  of  A'  and  permutations  of  columns  of  E  wiU  bring  E  to  diagonal  form.  The  Steps  5)  and 
6)  wiU  impose  E  =  Id  while  the  other  steps  wiU  let  (£^,A)  unchanged.  It  is  sufficient  to  consider 
the  case  when  A  has  on  diagonal  only  degenerate  clusters.  Then  after  the  permutations  at  1),  E 
results  block  diagonal  with  the  blocks  corresponding  to  degenerate  clusters.  In  this  case  F  =  E~'^, 
thus  by  Step  b)  E  =  Id. 

4  The  Algebraic  Multigrid  Projection 


The  solutions  {E,A)  of  (1),  obtained  by  a  GRRP  on  a  single  level  may  be  obtained  by  an  MG 
projection,  transferring  the  problem  to  another  level,  (e.g.,  to  a  coarser  level).  The  problems  on 
the  initial  level  (1)  and  on  the  new  level  have  the  same  form,  and  the  same  solutions. 

Assume  that  the  problem  (1)  for  (A, U,T): 

AUE  =  UEA  +  TE  (8) 

is  transfered  into  a  problem  for  {A' ,  U',  T'): 

A'U'E  =  U'EA  +  T'E  (9) 

such  that: 

(Al)  There  exists  a  matrix  J  with  U'  =  JU 
(A2)  U'  has  independent  columns 
(A3)  T'  is  defined  by 

T' =  A'U' A  J{T  -  AU)  (10) 
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The  next  result  provides  the  theoretical  basis  of  the  MG  projection: 

Theorem  (The  Two  Level  Projection  Theorem) 

If  assumptions  (Al)  to  (A3)  hold  and  (A,  U^T)  has  solutions,  then  the  sets  of  solutions  for  (A,  U,  T) 
and  (A',U',T')  coincide  and  all  solutions  are  equivalent. 

Proof  Let  (E,  A)  be  a  solution  for  {A,  U,  T').Then  by  assumptions  (Al),  (A3)  and  (8)  it  follows: 

A'U'E  -  U'EA  -  T'E  =  J(AUE  -  UEA  -  TE)  =  0  (11) 

Thus  {E,  A)  is  a  solution  for  (A',  U',  T')  (9).  Assume  that  (F,  0)  is  another  solution  for  (A',  U',  T'). 
Then  by  (A2)  and  Lemma  1  the  pairs  (F,  0)  and  (F,A)  are  equivalent.  By  Lemma  2  it  follows 
that  (F,  0)  is  a  solution  for  (A,  U,  T). 

Problems  (8)  and  (9)  have  the  same  form.  To  find  a  solution  for  (8),  the  two  level  projection 
transfers  U  and  the  residual  T  —  AU  by  J  and  computes  a  solution  of  (9)  by  a  GRRP.  This  is 
described  by  the  algorithm: 

Two-Level-Projection 

1)  Transfer  U'  =  JU 

2)  Transfer  T'  =  A'U'  -H  J{T  -  AU) 

3)  Get  (F,A)  for  (A',U',r)  by  a  GRRP 

Observe  the  freedom  in  choosing  A'  and  J  in  the  above  theorem  and  algorithm.  In  particular 
the  dimension  of  A'  may  be  much  smaller  than  the  dimension  of  A.  The  A'  can  also  be  used  in 
relaxations  in  MG  cycles  to  approximate  the  eigenvectors  U . 

The  Multigrid-Projection  (MGP)  algorithm  is  a  straightforward  generalization  of  the  Two- 
Level-Projection,  in  which  a  sequence  of  problems  AiUiE  =  UiEA  +  TiE  for  i  =  1, ...,/  is  defined 
using  transfers  satisfying  (Al),  (A2),  (A3).  For  i  =  I  one  has  the  initial  problem,  whereas  for  i  =  1 
the  final  one  to  which  the  GRRP  is  applied.  The  J,-  denotes  a  transfer  matrix  from  level  i  -f  1  to 
level  i. 


MGP 

For  i  =  /  —  1  to  1  do; 

1)  Transfer  Uj  =  JiUi+t 

2)  Transfer  T,  =  A,F,  -I-  Ji{Ti+i  -  Aj+iF.+i) 
end 

3)  Get  (F,A)  for  (Ai,Fi,ri)  by  a  GRRP 
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Corollary  (The  MGP  Theorem) 

If  in  the  MGP  algorithm,  the  Ui  for  i  =  1, . . . ,  /  have  the  same  number  of  columns  and  their  columns 
are  independent,  and  if  [Ai,Ui,Ti)  has  solutions,  then  the  sets  of  solutions  of  (Ai,  Ut,Ti)  and  of 
{Ai,Ui,Ti)  coincide,  and  all  solutions  are  equivalent. 

The  proof  goes  by  induction  by  the  number  of  levels  I  using  the  Two  Level  Projection  Theorem. 

Remarks  Assume  that  in  the  two  level  projection  the  matrices  A,  A' ,  U  have  the  dimensions 
nxn,  m  X  m,  nxq,  and  that  n'>  m>q.  The  work  required  to  compute  a  pair  {E,  A)  by  a  GRRP 
on  the  initial  level  is  of  order  O(q^nCA)  due  to  the  scalar  products  (  U^AU  and  U^U),  where 
tiCa  is  the  amount  of  work  required  to  multiply  A  with  a  vector,  (the  diagonalization  process, 
of  order  q^,  is  considered  negligible  in  comparison  with  q^n  ).  The  amount  of  work  to  obtain 
a  pair  {E,A)  by  the  two  level  projection  is  of  order  0{qnCA  +  qnCj  +  q'^mCA'),  which  may  be 
regarded  in  many  cases  as  0{qnCA)-  This  may  suggest  a  reduction  of  work  from  order  q^n  to 
qn.  One  is  interested  not  only  in  E  and  A  but  also  in  the  separated  solution  UE.  To  compute 
UE  alone  requires  q^n  operations,  which  is  the  order  of  work  of  a  fine  level  GRRP.  Instead  of  the 
expensive  direct  computation  of  UE,  one  may  use  other  levels  and  the  computed  A  to  approximate 
the  q  vectors  of  UE  efficiently.  Moreover,  this  approach  allows  one  to  improve  the  accuracy  of  the 
eigenspace  spanned  by  the  columns  of  U. 

5  Multigrid  Combined  Cycles  and  FMG  Algorithms 

This  section  presents  an  MG  cycle  which  consists  of  a  combination  of  the  MGP  with  the  usual  MG 
cycles.  The  combined  cycles  are  incorporated  in  an  FMG  algorithm.  This  algorithm  is  used  to 
compute  both  the  eigenvalues  A  and  the  eigenvectors  U .  For  simplicity  assume  first  that  there  are 
only  two  levels.  The  notations  from  the  previous  section  are  used.  Consider  the  single  level  subspace 
iteration  type  algorithm  [11],  [13],  used  to  obtain  the  largest  eigenvalues  A  and  the  corresponding 
eigenvectors  U  of  the  problem: 

AU  =  UA  (12) 
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Subspace- Iteration 

1)  Relax  AU  =  UK 

2)  Update  (C/,A)  by  {E,K)  using  a  GRRP 

The  steps  1)  and  2)  may  be  improved  using  another  level.  Assume  next  T  =  0.  At  step  1) 
the  relaxation  can  be  replaced  by  a  Two-Level-Solver-Cycle,  having  the  same  transfers  as  in  the 
MGP.  The  approximate  solutions  U  are  corrected  with  U'  by  step  5),  where  /  is  a  given  matrix, 
e.g.,  I  =  J'^. 


Two-Level-Solver-Cycle 

1)  Relax  AU  =  UKaT 

2)  Transfer  U'  ^  JU 

3)  Transfer  T'  =  A'U'  -|-  J(T  -  AU) 

4)  Relax  A'U'  =  U'K  -|-  T' 

5)  Correct:  U  =  U  A  I{U'  -  JU) 

6)  Relax  AU  =  UK  AT 

Step  2)  in  the  Subspace-Iteration  algorithm  can  be  replaced  by  a  Two-Level-Projection.  The 
Two-Level-Solver-Cycle  can  be  combined  with  the  Two- Level-Projection  in  a  Two-Level-Combined- 
Cycle: 


Two-Level-Combined-Cycle 

1)  Relax  AC  =  CA -I- r 

2)  Transfer  U'  —  JU, 

3)  Transfer  T'  =  A'U'  -|-  J{T  -  AU) 

4)  Get  {E,K')  for  {A',U',T')  by  a  GRRP 

5)  Backrotate  {E,K') 

6)  Separate  U'  =  U'E,  T'  =  TE,  A  =  A' 

7)  Relax  A'U'  =  U'K  A  T' 

8)  Correct  U  =  UA  I{U'  -  JU) 

9)  Relax  AU  =  UK  AT 

Denote  by  T  a  transfer  matrix  from  level  i  —  1  to  level  i.  The  Two-Level-Combined-Cycle  can 
be  directly  extended  to  an  MG  Cycle: 
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MG-Combined-Cycle  (1) 

For  i  =  /  to  2  do: 

1)  Relax  AiUi  -  UiA  +  Ti 

2)  Transfer  Ui-\  =  Ji-iUi 

3)  Transfer  Ti-i  =  Ai-iUi-i  +  Ji-\{Ti  —  AiUi) 
end 

4)  Get  {E,k')  for  (Ai, by  a  GRRP 

5)  Backrotate  {E,A!) 

6)  Separate  U\  —  U\E,  T\  =  T\E,  A  =  A' 

7)  Relax  A\U\  =  C^iA  +  Ti 
For  i  =  2  to  /  do: 

8)  Correct  Ui  —  UiA  Ii{Ui-\  -  Ji-\Ui) 

9)  Relax  AiUi  =  UiA  +  Ti 
end 

An  FMG  algorithm  can  be  defined  by: 

FMG  (1) 

For  i  =  1  to  /  do: 

If  i  =  1  solve  the  problem  by  Subspace-Iterations 
Else 

1)  Interpolate  Ui  —  liUi-i,  set  Ti  =  0 

2)  Do  few  MG-Combined-Cycles  (i) 

Endif 

The  transfers  at  steps  3)  and  8)  in  the  MG-Combined-Cycle  are  FAS  type  transfers  [6].  Usually 
the  FMG  (from  Full  MG,  [6])  starts  by  approximating  the  solution  (Ui,  A)  on  a  coarse  level,  i  =  1, 
then  interpolates  the  solution  to  successively  finer  levels.  On  each  level  the  solution  {Ui,A)  is 
improved  by  a  few  MG  cycles.  In  the  general  algebraic  setting  no  assumption  is  done  on  the  levels 
being  coarse  or  fine. 
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6  The  Fixed  Point  Theorem  for  MG  Cycles 

Usually  relaxations  do  not  change  the  exact  solutions  of  (13): 

AU-UA^T  (13) 

Examples  of  such  relaxations  are: 

Un+l  =  Un  +  MiT-AUn-UnA)  (14) 

e.g.,  Jacobi  type  or  relaxations  which  have  locally  the  above  form,  e.g.,  Gauss-Seidel  or  Kaczmarz. 
Power  iterations  change  the  exact  solutions  if  they  are  not  coupled  with  normalizations.  One  may 
consider  relaxations  which  are  more  general  procedures,  e.g.,  including  rescalings,  orthogonaliza- 
tions,  or  projections  in  clusters.  The  next  theorem  assumes  that:  1)  an  exact  solution  U  of  (13) 
has  linearly  independent  columns  and  the  eigenvalues  in  A  are  sorted;  2)  the  transfer  J  in  the 
Two-Level-Combined-Cycle  maps  the  solution  U  into  U'  =  JU  with  linearly  independent  columns 
and  with  the  same  number  of  columns;  3)  on  both  levels,  the  relaxations  don’t  change  the  exact 
solutions  of  the  respective  levels.  These  are  natural  assumptions  met  generally  by  MG  procedures. 
For  simplicity,  as  in  MG  algorithms,  in  the  Two- Level-Combined-Cycle  and  in  the  MG-Combined- 
Cycle,  the  solutions  of  the  problem  on  the  level  on  which  the  cycles  start,  i.e.,  the  (U,  A)  respective 
{Ui,Ai),  will  be  called  fine  level  solutions. 

Theorem  (The  Two-Level  Fixed  Point  Theorem) 

The  Two-Level-Combined-Cycle  has  as  fixed  points  the  exact  fine  level  solutions. 

Proof  Suppose  that  (U,A)  is  a  solution  of  (13).  The  relaxation  in  1)  in  the  Two-Level- 
Combined-Cycle,  does  not  change  (U,A).  Due  to  2)  and  3)  the  transfers  of  the  fine  level  solutions 
U,  A  are  coarse  level  solutions,  [/',  A  of 

A'U'  -U'A  =  T'.  (15) 

The  result  of  the  projection  and  backrotation  is  {Id,  A),  by  Lemma  3.  Thus  step  6)  leaves  {U',A) 
unchanged  and  the  same  holds  for  the  relaxation  7).  Since  U'  =  JU  initially  and  U'  is  not  changed 
by  the  coarse  level  steps,  the  correction  8)  leaves  U  unchanged. 

By  induction  one  gets  the 
Corollary  (The  MG  Fixed  Point  Theorem) 

The  MG-Combined-Cycle  has  as  fixed  points  the  exact  fine  level  solutions. 

Generally,  a  fine  level  solution  would  not  be  a  fixed  point  of  an  MG  cycle  without  backrotations, 
since  the  projection  may  permute  the  solutions  for  example.  Moreover,  a  fixed  point  solution  would 
not  be  a  stable  solution  without  using  backrotations,  in  the  case  of  clustered  eigenvalues,  (e.g.,  due 
to  relaxations  and  projections).  This  is  very  important  for  the  convergence  and  the  robustness 
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of  the  algorithms.  Other  MG  cycles  can  be  defined  where  the  GRRP  and  the  backrotations  are 
performed  on  any  intermediate  level.  It  is  easy  to  see  that  the  above  theorem  holds  for  these  cycles 
too. 

7  Computational  Results 

The  next  examples  illustrate  the  efficiency  of  the  FMG  and  MG  cycles  for  a  Schrodinger  eigenvalue 
problem: 

(A  -  V)u  =  Xu  (16) 

discretized  in  a  box  with  the  edge  a  -  27r/10.  Periodic  boundary  conditions  are  assumed.  The 
problems  are  in  2-D.  In  the  notation  k  -  FMG  -  1/2)1  the  constant  k  is  the  number  of  MG 

cycles  performed  on  each  level;  the  ui,  (1/2)  is  the  number  of  relaxations  performed  in  the  MG 
cycle,  on  each  level  in  the  path  from  fine  to  coarse,  (coarse  to  fine).  Such  a  V  cycle  wiU  be  denoted 
y(i/i,i/2). 

The  releixation  is  Red-Black  Gauss-Seidel.  The  coarsest  grid  has  4x4  points.  The  projection  is 
performed  on  level  1,  the  coarsest  grid.  On  the  second  level  two  relaxations  are  performed,  showing 
in  many  tests  a  cheap  and  substantial  improvement  of  the  V  cycles  convergence  rate.  The  coarse 
level  linear  systems  were  solved  exactly,  using  the  eigenvalues  obtained  by  the  projection,  this  not 
being  necessary.  The  eigenvalues  are  updated  by  Rayleigh  Quotients  after  the  cubic  interpolation 
of  the  solutions  to  the  current  finest  level  during  the  FMG.  The  eigenvectors  are  normalized  to  1 
on  the  current  finest  levels,  and  to  the  FAS  norm  on  the  coarsest  level,  after  projection. 

The  results  in  Table  1  show  that  a  second  order  scheme  was  obtained  by  an  1-FMG-V(1,1) 
algorithm.  The  potential  was  V{x,y)  =  2  +  0.1sm(10x  -I-  lOj/),  chosen  to  produce  a  splitting  of 
the  first  cluster  of  four  equal  eigenvalues  into  two  degenerate  clusters  with  very  close  eigenvalues. 
Observe  the  first  3  equal  digits  of  the  close  clustered  eigenvalues  and  the  13  equal  digits  of  the 
degenerate  eigenvalues,  on  all  levels.  On  level  5,  8  cycles  were  performed  to  show  the  constant 
convergence  rate  per  cycle  of  1/10  (see  cycles  3  and  8  where  the  convergence  rate  is  exactly  1/10). 
The  eigenvectors  came  out  precisely  orthogonal,  even  in  the  cluster  and  degenerate  eigenspaces, 
although  the  projection  was  performed  only  on  the  coarsest  level,  (see  the  scalar  products  of  order 
10“^^  of  the  eigenvectors  on  level  5,  in  Table  2).  In  the  first  V  cycle  on  all  levels,  a  convergence  rate 
of  about  1/100  was  obtained.  The  next  example,  see  Table  3,  shows  that  without  the  backrotations 
the  eigenvectors  fail  to  converge  and  the  residuals  remain  stuck  at  order  1  on  aU  levels  except 
the  coarsest  level.  A  5-FMG-V(l,l)  algorithm  was  used  with  no  backrotations  (but  sorting  the 
eigenvalues,  which  is  a  first  step  in  backrotations  ).  Even  on  level  2,  the  algorithm  gets  stuck.  The 
eigenvectors  just  keep  rotating  in  the  cluster,  rendering  the  coarse  level  corrections  ineffective.  A 
few  observations:  1)  The  cluster  is  well  separated  from  the  first  eigenvalue  due  to  the  relaxation  and 
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coarse  level  approximations  of  eigenspaces.  Two  clusters  also  may  become  well  separated.  2)  The 
eigenvalues  are  accurately  approximated  (compare  with  Table  1)  showing  that  the  eigenspace  is 
well  approximated.  A  single  MG  projection  at  the  end  may  be  sufficient  to  separate  the  degenerate 
eigenspaces.  3)  Orthogonality  of  eigenvectors  is  also  lost  even  for  the  eigenvectors  with  different 
eigenvalues. 
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Table  1 

1-FMG-V(1,1),  2-D,  5-EV,  5-LEV 


vector  I  first  res 


last  res 


E  V  E  L  1 


eigenvalue 


1 

0.28E-13 

0.89E-13 

2 

0.84E-13 

0.73E-13 

3 

0.56E-13 

0.45E-13 

4 

O.llE-12 

O.lOE-12 

5 

0.64E-13 

0.52E-13 

-0.19999866430865E+01 

-0.83024036274094E+02 

-0.83024036274094E+02 

-0.83089844196732E+02 

-0.83089844196733E+02 


E  V  E  L  2 


0.67E-03 

0.35E+00 

0.35E+00 

0.35E+00 

0.35E+00 


E  V  E  L  3 


0.42E-03 

0.50E-01 

0.50E-01 

0.50E-01 

0.50E-01 


E  V  E  L  4 


0.13E-03 

0.43E-02 

0.43E-02 

0.43E-02 

0.43E-02 


1 

0.21E-01 

2 

0.30E+02 

3 

0.30E+02 

4 

0.30E+02 

5 

0.30E+02 

-0.19999793397309E+01 

-0.97190595196867E+02 

-0.97190595196868E+02 

-0.97281226562455E+02 

-0.97281226562455E+02 


1 

0.64E-02 

2 

O.llE+02 

3 

O.llE+02 

4 

O.llE+02 

5 

O.llE+02 

-0.19999761538938E+01 

-0.10069661549360E+03 

-0.10069661549360E+03 

-0.10079424742753E+03 

-0.10079424742753E+03 


0.18E-02 

0.30E+01 

0.30E+01 

0.30E+01 

0.30E+01 


-0.19999752449715E+01 

-0.10162979203934E+03 

-0.10162979203934E+03 

-0.10172931140738E+03 

-0.10172931140738E+03 


LEVELS 

1 

1 

0.46E-03 

0.36E-04 

-0.19999750026388E+01 

2 

0.76E+00 

0.40E-03 

-0.10186970728937E+03 

3 

0.76E+00 

0.40E-03 

-0.10186970728937E+03 

4 

0.76E+00 

0.40E-03 

-0.10196970729590E+03 

5 

0.76E+00 

0.40E-03 

-0.10196970729590E+03 

3 

1 

0.35E-05 

0.33E-06 

-0.19999749801202E+01 

2 

0.27E-04 

0.26E-05 

-0.10186970049930E+03 

3 

0.27E-04 

0.26E-05 

-0.10186970049930E+03 

4 

0.27E-04 

0.26E-05 

-0.10196970049780E+03 

5 

0.27E-04 

0.26E-05 

-0.10196970049780E+03 

8 

1 

0.97E-11 

0.26E-10 

-0.19999749799142E+01 

2 

0.29E-09 

0.31E-10 

-0.10186970048459E+03 

3 

0.29E-09 

0.31E-10 

-0.10186970048459E+03 

4 

0.29E-09 

0.31E-10 

-0.10196970048302E+03 

5 

0.29E-09 

0.31E-10 

-0.10196970048302E+03 

Table  2 

Scalar  products  between  eigenvectors  on  level  5 

Vector  1 

Vector  2 

Scalar  Product 

1 

1 

O.lOE+01 

1 

2 

-0.19E-13 

1 

3 

-0.16E-14 

1 

4 

-0.19E-13 

1 

5 

0.43E-14 

2 

2 

O.lOE+01 

2 

3 

0.60E-14 

2 

4 

0.54E-13 

2 

5 

0.12E-12 

3 

3 

O.lOE+01 

3 

4 

-0.17E-12 

3 

5 

0.24E-12 

4 

4 

O.lOE+01 

4 

5 

0.63E-14 

5 

5 

O.lOE+01 

I 

I 

I 


I 

i 
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5  -FMG-V(1 


cycle  vector 


Table  3 

,1),  2-D,  5-EV,  5-LEV, 


last  res  eigenvalue 


E  V  E  L  1 


1 

0.28E-13 

0.89E-13 

2 

0.84E-13 

0.73E-13 

3 

0.56E-13 

0.45E-13 

4 

O.llE-12 

O.lOE-12 

5 

0.64E-13 

0.52E-13 

-0.19999866430865E+01 

-0.83024036274094E+02 

-0.83024036274094E+02 

-0.83089844196732E+02 

-0.83089844196733E+02 


E  V  E  L  2 


1 

1 

2 

3 

4 

5 

0.21E-01 

0.30E+02 

0.30E+02 

0.30E+02 

0.30E+02 

0.67E-03 

0.17E+01 

0.17E+01 

O.llE+01 

O.llE+01 

-0.19999793397309E+01 

-0.97190595196867E+02 

-0.97190595196868E+02 

-0.97281226562455E+02 

-0.97281226562455E+02 

5 

1 

0.78E-08 

0.16E-09 

-0.19999785210023E+01 

2 

0.16E+01 

0.17E+01 

-0.96920257120980E+02 

3 

0.16E+01 

0.17E+01 

-0.96920257120980E+02 

4 

0.35E+01 

0.59E+01 

-0.97015473866025E+02 

5 

0.35E+01 

0.59E+01 

-0.97015473866025E+02 

L  E  V  E  L  3 

1 

1 

0.61E-02 

0.36E-03 

-0.19999761161604E+01 

2 

O.llE+02 

0.14E+01 

-0.10069706261680E+03 

3 

O.llE+02 

0.14E+01 

-0.10069706261680E+03 

4 

0.14E+02 

0.25E+01 

-0.10080438766161E+03 

5 

0.14E+02 

0.25E+01 

-0.10080438766161E+03 

L  E  V  E  L  4 

1 

1 

0.16E-02 

0.94E-04 

-0.19999752199391E+01 

2 

0.34E+01 

0.77E+00 

-0.10162995680857E+03 

3 

0.34E+01 

0.77E+00 

-0.10162995680857E+03 

4 

0.31E+01 

0.25E+01 

-0.10172932150242E+03 

5 

0.31E+01 

0.25E+01 

-0.10172932150242E+03 

E  V  E  L  5 
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8  Conclusions 


Proofs  for  the  algebraic  multigrid  projection  theorem  and  for  the  MG  fixed  point  theorem  for  cycles 
coupling  relaxations,  projections,  backrotations  and  inter-level  transfers,  are  presented.  Important 
computational  work  savings  can  be  obtained,  for  example,  when  the  transferred  problem  has  sig¬ 
nificantly  smaller  size  than  the  initial  problem.  The  MGP  and  backrotations  can  be  coupled  in 
MG  cycles,  in  which  the  fine  level  exact  solutions  are  not  changed  by  the  MG  cycle.  Thus  fine  level 
solutions  are  fixed  points  for  the  MG  cycles.  This  is  important  for  the  efficiency  and  robustness  of 
the  MG  eigenvalue  algorithms.  Computational  examples  which  show  the  failure  of  the  algorithms 
in  absence  of  backrotations,  and  the  difficulties  to  be  overcome  by  the  MG  cycles  are  presented. 
For  the  same  problems,  the  efficiency  of  the  MGP  and  backrotations  is  illustrated.  These  problems 
present  special  computational  difficulties  such  as  very  close  and  equal  eigenvalues. 
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